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1. INTRODUCTION 

Numerous reviews on the effectiveness of e-Learning were within the context of language learning 
that primarily includes in criteria of quantitative studies [1], transparency of statistical information [2-3] or 
similarity of the predefined outcome measures [4]. Moreover, only few researches which included both 
qualitative and quantitative studies can be considered as relevant [5]. This because, a set of classifications 
was frequently used to identify the effectiveness of e-Learning solution such as, several papers use both 
‘learning outcome’ and ‘satisfaction’ as definitions for effectiveness [6-8]. The number of papers in this list 
would of course change if the remaining abstracts were coded, but the author’s find that the most common 
definitions are expected to stay relatively stable, as they have not significantly changed in recently reviewed 
abstracts. Having multiple ways of understanding the effectiveness of e-Learning allows professionals and 
researchers substantial flexibility in defining, measuring and determining the effectiveness of an e-Learning 
solution [9]. The results can help teachers attributed improved in student learning to various technology use; 
online communication with peers and experts reduced teacher isolation, enhanced professional practice and 
gave access to perspectives and experiences otherwise unavailable; but the additional workload discouraged 
several teachers’ [10]. 

Quantitative method was a research method that deals with numbers and anything that was 
measurable such as investigation of occurrences and their relationships [11]. This includes the numerical data 
analysis such as the frequency, mean and standard deviation. Furthermore, the theory was deductively and 
mentioned at the beginning of the research expectation outcomes. The quantitative method objective was to 
test or to verify a theory by collecting the data theory and reflects on its confirmation or disconfirmation by 
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the results [12]. Finally, the quantitative method was a data collection executed to verify the research’s facts 
and phenomena. This can be achieved by measuring or comparing the variable of the data and must be 
reported in statistical analysis where it is a suitable method in this study to measure the learning effectiveness 
among children. 

Mobile technologies have become an integral part of people's daily life that showed a significant 
progress in its development within recent years [13]. Nowadays, the m-learning (Mobile Learning) has 
become the attention and focus a few scientists and work on its development and distribution from all over 
the world [14-16]. The mobile learning term denotes the use of mobile applications installed on a mobile 
device (tablet or smartphone) that used in the education process at school [17-18]. The implementation of this 
mobile learning is not a simple process when it is for young age students and children’s learning. Textbook’s 
author, children (students), parents and teachers play an important role in the formation of the children 
character, interests and social behaviour through learnings’ process [19]. Therefore, by applying the M- 
learning in children education, it’s shown a significant contribution for children to build their character, 
behaviour and interest in learning. This could be done by developing an e-learning application that could run 
on an Android device platform. 

The Electroencephalograms (EEG) record the electric activity of a human's brain through electrodes 
that are attached to the scalp that used traditionally for medical purposes in diagnosis and management of 
various brain-related disorders such as the case of epilepsy and abnormal neuronal activity [20]. The EEG 
feature also assists in tracking patients’ brain activities while patients are carrying out their daily tasks. 
EEG’s also capable of monitoring the changes in someone’s emotions shown by the brain signals. Moreover, 
(Potter & Bolls, 2012) explain that the EEG was a direct measure of central nervous system activity that was 
initiated by information processing in the brain [21]. Besides, (Skroumpelou et al., 2015), pointed out that 
EEG was a brain imaging tool that supplies researchers with an insight into human’s affective state of mind 
[22]. According to (Ramirez, 2012) the EEG device could identify the positive emotion from signal of the 
brain wave with high accuracy [23]. According to [24], the positive emotion felt by the student is directly 
proportional to the level of learning effectiveness. Now, there are few EEG device already available in 
market to detect the human emotion and learning effectiveness. 


2. RESEARCH METHOD 

An already developed mobile learning application (‘Sains Awal PraSekolah’) was used in this 
research and an appropriate questionnaire was created. The mobile learning application was evaluated using 
two android phones (one where the mobile learning application installed and one to monitor the EEG device 
result) in order to achieve that all aspects need to be considered like the effectiveness of the mobile learning. 
The EEG device that was used in this research was MindWave EEG headset and Effective learner 
application. The Effective learner application used to monitor EEG learning effectiveness result in real time. 
After the data have been collected, the data then analyzed. Figure | shows the research method that uses data 
collection of quantitative as its technique. The research method of this research was as follow: 
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Figure 1. The research method in the research 
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Firstly, the demography of the participants was recorded so that the user information is recorded. 
Next, The participants will wear an EEG device that monitors the participant effectiveness percentage while 
using an m-learning application while monitored by the interviewer. Finally, the rate result from the EEG 
device was recorded according to the level of effectiveness stated in the result 


3. RESULTS AND ANALYSIS 

The evaluation of the learning effectiveness of the mobile learning application was conducted in 
three different locations based on its sociology and economy. This to confirm whether that the mobile 
learning application effective in different level of technology exposure or not. The evaluation was conducted 
at a different location in Sabah (a state in Malaysia) that includes rural school (Tadika Advent Goshen Kota 
Marudu), suburban school (Pacos Trust Penampang) and urban school (Pusat Minda Lestari UMS Kota 
Kinabalu). There is a total of 104 participants that involve in the evaluation that consists of 98 children and 6 
teachers. The demography of the participants is as follows. 

In total, 98 children participated in this study. As shown in Table 1, the children distributed in the 
age groups of 4 years and 5 years old. This profile was typical of kindergarten children in the Malaysian 
population. In addition, the demographics of the data showed that about 47 (47.959%) of the children from 
the rural area, 22 (22.449%) from the suburban area and 29 (29.592 %) from the urban area. The category of 
the area was identified by the Majlis Perbandaran Sabah. Regarding the race classification, the number of 
Kadazan, Dusun, Melayu, Timor and Foreign (Japanese) were 21%, 48%, 27%, 1% and 1% respectively. 


Table 1. The Demography of Data Collected for Children 








Question Range Frequency Percentage 
Rural Suburban Urban Total 
Gender Male 25 12 15 52 52.1 
Female 22 10 14 46 46.9 
Total 47 22 29 98 100 
Age 4 years old 12 8 4 24 24.5 
5 years old 35 14 25 74 75.5 
Total 47 22 29 98 100 
Race Kadazan 1 20 21 21.4 1 
Dusun 45 2 1 48 49.0 
Melayu - - 27 27 27.6 
Timor 1 - - 1 1.0 
Foreign (Japanese) - - 1 1 1.0 
Total 47 22 29 98 100 





As of the teacher, a total of 6 teachers involved. Table 2 shows the demography of teacher that 
articipated during the evaluation. A total of 6 teachers are interviewed where 2 teachers for each school is 
interviewed respectively. 3 (50%) of the teacher are between 20-30 years old and 3 (50%) of the rest are 
between 30 to 40 years old. Next, 2 (40%) of the teacher are Kadazan race and 4 (60%) the rest are 
Dusun race. 


Table 2. The Demography of Data Collected for Teacher 








Question Range Frequency Percentage 
Rural Suburban Urban Total 

Gender Female 2 2 2 6 100 
Total 2 2 2 6 100 
Age 20-30 years old 2 1 3 50 
30-40 years old 1 2 3 50 
Total 2 2 2 6 100 
Race Kadazan 1 1 2 40 
Dusun 2 1 1 4 60 
Total 2 2 2 6 100 





3.1. Result of Electroencephalograms (EEG) Device 

The Electroencephalogram (EEG) device capable of recording the brain activity in real time and 
shows the learning effectiveness using the MindWave EEG headset and its application. Therefore, the EEG 
device could be considered as a reliable device to detect the children learning effectiveness. According to 
(Gasah et al., 2018), children focus, and attention are only between three to five minutes [25]. Since the 
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average of children attention only between three to five minutes, the data between that period only, will be 
considered for evaluation because children were in their full attention during that period. Table 3, Table 4 
and Table 5 shows the result of the EEG. The percentage value represents the learning effectiveness 
experienced by the children less than fifty per cent (<50%) means less effective and more than fifty per cent 
(>50%) means effective learning. 

Table 3 shows the EEG device score for rural children. The score of the EEG device for less than 3 
minutes indicate that almost 51.537% of effectiveness in children from 7 children only. The mean increases 
to 53.208% when the period are less than 5 minutes were taken from 25 children. This result the opposite 
from the expected result from [13] because the effectiveness of learning should be decreased when the 
time increases. 


Table 3. EEG Device Score at ““Tadika Advent Goshen” 
Rural Kids (Kota Marudu) 








Minute No Minimum Maximum Mean Std. Deviation 
<3 Mins Time (mm:ss) 7 1:38 2555 2622 0.02 
Percentage (%) 7 24:2 67.2 51.357 16.52 
Valid N (listwise) 7 
<5 Mins Time (mm:ss) 25 1:38 4:47 3:24 0.03 
Percentage (%) 25 24.2 95 53.208 19.68 
Valid N (lustwise) 25 





Table 4 shows the EEG device score for suburban children. The score of the EEG device for less 
than 3 minutes indicate that almost 82.186% of effectiveness in children from 7 children. This then shows a 
significantly decreasing to 74.41% when the period is less than 5 minutes were taken from 10 children. This 
result followed the prediction of the result in phase one where the effectiveness in learning will be decreasing 
to time. Even though, the level of high level of effectiveness that reaches more than 82% show that the 
mobile learning application in this area could build a positive emotion to children. 


Table 4. EEG Device Score at “Pacos Trust” 
Rural Kids (Kota Marudu) 








Minute No Minimum Maximum Mean Std. Deviation 
<3 Mins Time (mm:ss) wr 0:36 2:51 1:53 0.04 
Percentage (%) 7 68.3 100 82.186 11.18 
Valid N (listwise) 7 
<5 Mins Time (mm:ss) 10 0:36 4:35 2:35 0.06 
Percentage (%) 10 39.8 100 74.41 18.13 
Valid N (lustwise) 10 





Table 5 shows the EEG device score for suburban children. The score of the EEG device for less 
than 3 minutes indicate that almost 78.667% of effectiveness in children were taken from 3 children only. 
This then shows a significantly decreasing to 61.752% when the period is less than 5 minutes were taken 
from 21 children. This result followed the prediction of the result in phase one where the effectiveness in 
learning will be decreasing to time. Even though, the level of high level of effectiveness that reaches more 
than 78% show that the mobile learning application in this area was effective. 


Table 5. EEG Device Score at “PML UMS” 
Rural Kids (Kota Marudu) 








Minute No Minimum Maximum Mean Std. Deviation 
<3 Mins Time (mm:ss) 3 2:06 2:59 2:27 0.02 
Percentage (%) 3 71.4 92 78.667 11.56 
Valid N (listwise) 3 
<5 Mins Time (mm:ss) 21 2:06 4:56 3:59 0.03 
Percentage (%) 21 29:9 94 61.752 20.52 
Valid N (lustwise) 21 





Indonesian J Elec Eng & Comp Sci, Vol. 17, No. 1, January 2020: 191 - 196 


Indonesian J Elec Eng & Comp Sci ISSN: 2502-4752 0 195 





3.2. Finding and Discussion 

The EEG device score shows that the average percentage of children having effective learning in 
less than three-minute study for rural children (51.357%), suburban children (82.186%) and urban children 
(78.667%). This show that the m-learning application is effective in educating the suburban children 
compared to urban children and rural children. 

Next, the study duration that more than three minute and less than five minutes show an increment 
for rural children (53.208%) and decrement to suburban children (74.41%) and urban children (61.752%) 
respectively. This proves that the children learning efficiency will decrease within time because of two out of 
three schools shown the effectiveness decrement within this experiment. Finally, the average of the 3 areas 
could EEG score for less than three minutes is 70.737% with standard deviation of 13.087 and less than five 
minute is 63.123% with standard deviation of 19.444. The result of the EEG scores also shown that the 
mobile learning application capable of teaching the children effectively nearly 63%-71%. 


4. CONCLUSION 

The measuring of the effectiveness in learning not only give us a way to measure the effectiveness 
of the lesson taught but also give us a way to know the capability of the children level of understanding in 
classroom. Besides, the method used to measure the children learning effectiveness prove that the mobile 
learning application (Sains Awal Prasekolah) could teaches the children effectively. The result from this 
experimental work shown that the mobile learning application could effectively teaching the children nearly 
63%-71%. Moreover, the purpose of measuring the level of effectiveness in the mobile learning application 
is to help the developer and teacher to identify whether the mobile learning application developed really 
could help children in learning or not. Besides, this experimental work could also be applied to any teaching 
materials such as in classroom, e-learning and self-learning to identify the students learning effectiveness. 
This help the educational field in identifying the problem in learning and provide a solution or improvement 
regarding the effectiveness and learning amongst student or children. 
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